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We obtain the Crooks and the Jarzynski non-equihbrium fluctuation relations using a direct 
quantum-mechanical approach for a finite system that is either isolated or coupled not too strongly 
to a heat bath. These results were hitherto derived mostly in the classical limit. The two main 
ingredients in the picture are the time-reversal symmetry and the application of the first law to the 
case where an agent performs work on the system. No further assumptions regarding stochastic or 
Markovian behavior are necessary, neither a master equation or a classical phase-space picture are 
required. The simplicity and the generality of these non-equilibrium relations are demonstrated, 
giving very simple insights into the Physics. 



I. INTRODUCTION 

In contrast to the situation in equilibrium statistical 
physics, and linear response theory, there are not so many 
well-established results for systems far from equilibrium 
[ll-Q. Two such extremely interesting results are the 
"nonequilibrium fluctuation theorem" (NFT) of Crooks 
[1] and the related Jarzynski equality [5|. Both have to 
do with the work done by /on a finite system coupled 
to a heat bath. We also mention here previous works 
P-Q , showing that the Kubo formalism, the fluctuation- 
dissipation theorem, and the associated detailed-balance 
relations are valid in a large class of nonequilibrium 
steady-state systems, and not only in equilibrium. 

The system under consideration is described by a time 
dependent Hamiltonian 'H{X{t)), where the parameter 
X is a time-dependent c-number, often coupled linearly 
to an observable of the system. At t = io the system is 
prepared in thermal equilibrium at the temperature T. 
The thcrmalization is achieved by connecting it for a long 
enough time to a thermal bath at that temperature. Af- 
ter that, within the time t = ti, the system undergoes 
a "work process". This means that an "agent" changes 
the value of X from Xq to Xi. During this process a 
work W is performed on the system, and possibly some 
heat Q is dissipated into the bath Q- In the simplest 
scenario the system is isolated, and heat flow is not in- 
volved. It should be emphasized that at the end of the 
work process, the system is in general not in equilibrium. 

The NFT deals with the probability distribution P{W) 
of the work W, whose experimental determination re- 
quires to repeat the process protocol many times, and 
to record the measured values of W. Specifically the 
NFT concerns the ratio Po^i{W) / Pi^o{-W) between 
the statistics of the forward scenario, and the statistics 
of the reversed scenario. In the latter, the system is equi- 
librated with the same bath under conditions such that 
AT = ATi . Then the time-reversed process protocol is re- 
alized, such that at the final time X = Xq. 

The objective of this paper is to present a simple 
derivation of the NFT in the quantum mechanical con- 
text, bypassing various subtleties that, in our view, have 



obscured the simple physics involved. The main issue 
is to define carefully the notion of work in the quantum 
mechanical context, and to clarify the role that is played 
by the bath. 

Outline: We refer to the evolution during a work pro- 
cess, and formulate for it a generalized detailed balance 
relation. Then we discuss the notion of work, leading 
to the NFT of Crooks. The main issue is the modeling 
the work agent, and the understanding of the role that is 
played by the bath. The implied Jarzynski equality and 
the implications on the wasted work and on the entropy 
production are briefly discussed. 



II. EVOLUTION DURING A WORK PROCESS 

The system under consideration is described by a time- 
dependent Hamiltonian T-L{X{t)). Let us assume that 
a classical "agent" changes the value of the c-number 
control parameter X from ATq at t = tg to Xi at t = ti. 
In some cases, but not in general, the actual duration 
of the time dependent stage might be r ^ |ti — <o|- Say 
that at i = to the system was prepared in some eigenstate 
of 'H{Xo). Then we can ask what is the probability 
VQ^i{m\n) that at the later time t = ti'it is measured in 
an eigenstate nrS^^ of %{Xi). Below we use the notation 
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In a later section we shall deflne the notion of work W, 
and shall explain that up to some uncertainty, we can 
make the identiflcation W = provided the system is 
isolated from the environment. 

For a strict quantum adiabatic process one has 
P(m|n) = 5n,m- But we are interested in more general 
circumstances. In particular we focus in this section on 
unitary evolution for which 
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where U is the time-evolution operator. What is im- 
portant for the derivation of the NFT is the micro- 
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reversibility of the dynamics, namely, 



Fi^o{n\m) 



Po-^i("i|«) 
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Note that in general the reversed process requires to 
transform some fields, e.g. to change the sign of the mag- 
netic field if present. 

For completeness it is also useful to define the notion of 
"classical dynamics" . Given phase-space, we can divide 
it into cells in some arbitrary desired resolution. Then 
we can regard n as an index that labels cells in phase 
space. The classical equations define a map 
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We use quantum style notations in order to make the 
relation to the quantum formulation clear. It follows that 
P(m|n), instead of being a stochastic kernel, becomes a 
deterministic kernel that induces permutations 
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The derivation in the next section does not depend on 
whether the dynamics is "classical" or "stochastic" or 
"quantum" in nature as long as the measure and the 
micro-reversibility are preserved. The preservation of 
measure is reflected by our discrete notations: If, say, 
we had deterministic dynamics that does not satisfy Li- 
ouville theorem, we could not have used the above "cell 
construction" 



of the system to absorb and emit energy from/to a driv- 
ing source —f{t)A. 

In complete analogy we define the following spectral 
kernel: 

Po-^iH (9) 

Here the superscript indicates whether we refer to the 
initial Hamiltonian H(Xq) or to the final Hamiltonian 
T-L(Xi). For the reversed process we write 

Pwo(w) (10) 



It immediately follows, in analogy with the usual detailed 
balance condition, that the ratio of the spectral functions 
Po~»i(w) and Pi^q{—uj) is determined by the ratio of the 
initial probabilities p^n ^ and Pn \ leading to 
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where both i^(^i) and F{Xq) refer to the same prepa- 
ration temperature T. Note again that if X does not 
change in time, this relation formally coincides with the 
detailed balance relation Eq.dH). 



III. THE GENERALIZED DETAILED 
BALANCE RELATION 



IV. THE NOTION OF WORK AND THE NET 
OF CROOKS 



The power spectrum of the fluctuations of an observ- 
able A is given by the following spectral decomposition 



Y^p^\{m\A\n)' SL-{E^-En)) (6) 



Here we assume a time independent Hamiltonian, and 
stationary preparation that can be regarded as a mixture 
of eigcnstates with weights p„ . For a canonical prepara- 
tion 
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where Z is the partition function, and F{X) is the 
Helmholtz free energy at temperature T, calculated here 
for the flxed value of the control parameter X . Then one 
obtains after two lines of straightforward algebra, the de- 
tailed balance relation 



exp 



(8) 



This relation plays a key role in the linear response the- 
ory. Speciflcally it reflects the ratio between the tendency 



The main difficulty in the quantum formulation of the 
NFT concerns the definition of work. Consider first an 
isolated system. Naively we can define W = oj, namely 
the work is the change in the energy of the system. But 
in the quantum reality this means that we have to do a 
measurement of the initial stage, hence the state of the 
system collapses and it is no longer canonical. 

Furthermore, assume that we want to consider a 
multi-stage process that extends over two time intervals 
to ti — J> ^2- We would like to say that the work done 
is the sum Wo-^i -I- With the above definition we 

have to perform a measurement at the time instant ti. 
But in the quantum mechanical reality we do not have 
the time for that... 

It is therefore clear that the definition of work requires 
refinement. One possible direction [l^] is to define 
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Then, in analogy with the theory of counting statistics 
[Ill4l3j , one might say that a continuous measurement is 
required, involving a weak coupling to a von Neumann 
pointer. The problem with this approach is that the 
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counting statistics quasi probability [12lll3l| has no simple 
physical interpretation, and might be even negative. 

It turns out that in the present context there is a simple 
way out of these subtleties. Instead of regarding X{t) as 
a c-number field, we regard it as a dynamical variable of 
an "agent" that is doing work. The total Hamiltonian 
can be formally written as 



H{r;X)+Hagent{X) 



(13) 



where r stands for system dynamical variables, and X is 
the agent degree of freedom. Then we define the work W 
as the change in the energy of the agent 



W — Eagent{0) — 'Hagent 



(14) 



where Eagent (0) is its initial energy, which is assumed to 
be well defined up to some small uncertainty. In the next 
section we clarify that for an isolated system W = w, 
to the extent that the above small uncertainty can be 
ignored, as should be the case for a classical agent. From 
here follows the Crooks relation 



Pi^o(-W) 



exp 



W - iF{Xi) - FiXo)) 



T 
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Instead of going on with an abstract discussion of what 
do we mean by "work agent" , we consider in the next 
section two simple prototype models that illuminate this 
notion. 



V. MODELING THE WORK AGENT 

In order to define the notion of work we find it es- 
sential to regard the "agent" as a dynamical entity. It 
can be another object ("piston") from/ to which energy 
is transferred, or it can be a field with which the system 
interacts, absorbing or emitting excitations ("photons"). 



A. Modeling the agent as a piston 

The prototype model for explaining the notion of work 
in standard thermodynamics textbooks is the gas-piston 
system that is illustrated in Fig[T] The "agent" on which 
work is being done is a piston that is free to move to 
infinity. After the piston is pushed out the gas particles 
stay in the box, and no longer interact with the piston, 
but possibly may interact (say) with a bath or with other 
agents. At the end of each single "run" of the experiment, 
there is an unlimited time to measure the energy of the 
freely moving piston in the desired resolution. 

The essential ingredient in the illustrated construction 
is the decoupling at the end of the interaction: After the 
piston moves outside of the shaded region, it becomes a 
free object whose kinetic energy we can measured with- 
out having a time limitation. 





FIG. 1: The system is a gas of particles in a box. The 
box region is indicated by grey. A representative trajectory 
is illustrated. The "agent" on which work is being done is 
a piston that is free to move to infinity. After the piston is 
pushed out the gas particles stay in the box, and no longer 
interact with the piston, but possibly may interact (say) with 
a bath or with other agents. At the end of each single "run" 
of the experiment, there is an unlimited time to measure the 
energy of the freely moving piston in the desired resolution. 



For presentation purposes, but without any loss of gen- 
erality, we consider a single gas particle and regard the 
box as one dimensional. The Hamiltonian is 

2 2 

n.^Ur,p;X,P) = |- + K„,(r) +u(r-A) + |^ (16) 

where u{r — X) ~ uoS{r — X) with uq = oo. Thanks to 
a potential Vbox the gas particle remains in the shaded 
region even if the piston is "out" . Once the piston is out 
the "system" no longer affects the "agent", nor affected 
by it. 

In order to visualize the dynamics it is convenient to 
define a = (m/M)^/^, and px ^ P, and py = aP, and 
X = r, and y = {l/a)X. Then the Hamiltonian takes the 
form 



'Ht. 
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l^ipi+P~y) + V,.,^ix)+uix~ay) (17) 



We assume that initially the piston is prepared in rest 
with some uncertainty AX in its position, and an asso- 
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ciated uncertainty AP 1/AX in its momentum. Ac- 
cordingly the uncertainty of the total energy is 

AE ^ [A/AX2]-i + A£;„ (18) 

The total Hamiltonian is a constant of motion. It follows 
that the probability distribution of the total energy E is 
a S -function. The total energy is the sum of the particle 
energy and the piston energy. Let us denote the increase 
in the particle energy as oj, and the decrease in the piston 
energy as W. It follows that the joint distribution is 

P(a;,W) = P{uj)5{W-Lu) (19) 

where the equality is justified to the extent that AE can 
be neglected. Under such conditions the distribution of 
work P{W) is the same as P{to)- 

The argument above has establishes the equality of 
P(yV) and P{uj) for a system that is prepared in a micro- 
canonical state, such that AE^^^t^^ is a small uncertainty. 
But trivially the equality of the two distributions extends 
to any mixture, and in particular to the canonical prepa- 
ration under consideration. We note that our definition 
of P{uj) in the previous section has assumed a c-number 
driving source, while here there is some uncertainty AX 
in the position of the piston. Accordingly a trade-off is 
required with regard to AX and SE. This trade-off is the 
physical limit of the NFT applicability. In practice, and 
in particular for large deviations, this uncertainty should 
not be an issue. 



B. Modeling the agent as a field 

In this subsection we consider another illuminating ex- 
ample for a "work agent" but with a different emphasis: 
here the agent is a field with which the system interacts, 
and the measurement is the detection of a field quanta. 
The reasoning below is based initially on the traditional 
weak coupling assumption. 

Consider a classical force T that arises, say, from a 
classical electric field that acts on charged particles. Tak- 
ing the coupling to be via the total dipole moment of the 
system, the interaction term is 

H.^.to.„-.,c„t = -T{t)J2n (20) 

where the r.i are the coordinates of the particles along 
the relevant axis, and J-{t) is a c-number force that is 
switched from J-q = aX = 0, to = ST at time ti. 

To see what is going on, think of expanding J-{t) in a 
Fourier integral, the Fourier components J-^^ are signif- 
icant on an interval of order l/r, where r is the actual 
duration of the variation, which is possibly small com- 
pared with \ti — io|- Small dJ- and/or small r make the 
relevant Fourier components small. From low order per- 
turbation theory it follows that the transitions are to 
levels E,„ whose energy is within ^ l/r of the initial en- 
ergy En, with probabilities proportional to Very 



importantly, energy is conserved in the sense that the ex- 
citation takes an energy w = E^ — E^ from the field [TJ] ■ 

While we employed here perturbation-theory thinking, 
these considerations are much more general. For stronger 
perturbations, one may think in terms of the evolution 
operator, propagating the system in time. In particular, 
the symmetries [l5j due to microscopic reversibility, will 
follow mutatis mutandis. 

One should not worry about the time-energy uncer- 
tainty even in the short r limit, the relevant scale for the 
NFT considerations is ti that can be much larger. We 
know that if we quantize the field a photon with the 
energy uj ~ Em — En will be destroyed during the tran- 
sition. 

In the absence of a coupling to the bath, let us as- 
sume that r is small such that its inverse is larger than 
the mean level spacing. Under such circumstances the 
transitions are into an energy range that contains many 
states, within an interval whose spectral width is l/r for 
short pulse, that saturates to a limiting value F f for long 
pulse. In the regime where first order-perturbation the- 
ory applies Tp becomes much smaller compared with the 
mean level spacing of the system. When a coupling to 
the bath is introduced, the levels of the system acquire an 
additional width F^. If the interaction is weak enough 
r B would also become smaller than the mean level spac- 
ing of the system. Under such circumstances the sharp 
levels become narrow well-separated peaks in the system 
density of states. 

For the reverse process, the lineshape around the levels 
in the final stage have in general not the same width as 
that of the corresponding peak in the forward process, 
but, by T symmetry, its total weight is the same, and 
this is what counts in obtaining Eq. (|11|) . Energy con- 
servation then implies that W = w, so that again the 
distributions of oj and of W are the same. This again 
establishes Ea. ([T5)) . 



VI. THE IRRELEVANCE OF THE BATH 

The Crooks relation and the Jarzynski equality con- 
cern the probability distribution of work done during 
non-equilibrium process that starts with a canonical 
state. We deduced in the previous sections that in the 
case of an isolated system P(yV) satisfies the same Crooks 
relation as P{(^). We now want to extend the validity of 
this relation to the case of non-isolated system. Inspired 
by the approach of Q , let us discuss whether an interac- 
tion with a bath can affect these relations. 

First scenario.— After the work process has ended 
we allow the system to relax to the bath temperature T. 
This additional step does not involve work, hence P(W) 
is not affected. 

Second scenario.— Assume that there is a finite 
system-bath coupling rj during the process. The dura- 
tion of the process is r. Regarding the system and the 
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bath as one grand-system we write 

Pi_o(-W;r/,T) 

'W ^ {Ftot{Xi;Tj) - FtotiXo-,!])) 



exp 



T 



(21) 



It should be clear that Po-^i{W) and Pi^o(-W) depend 
on both rj and t. But the ratio, according to Crooks, is 
independent of t. Still one suspects that the right-hand 
side depends on 77. But in fact this is not so. The ar- 
gument is as follows: The ratio is independent of r, and 
therefore we can evaluate it, without loss of generality, 
for T ^ 0; But in this "sudden" limit the result should 
be independent of 77, because the bath has no time to in- 
fluence the work. We therefore can set rj = 0, and deduce 
that without loss of generality 

Po^i(>V;77,t) 



Pi^o(-W; ry,T) 

'W-{F,ys{Xi)-F,ys(Xo)) 



exp 



T 



(22) 



without dependence on 77 and r. Hence the NFT is estab- 
lished for a process in which the system is non-isolated. 
In particular, it may interact with a thermal reservoir. 



VII. THE JARZYNSKI EQUALITY 

It is well known Q that the Jarzynski equality 0] is 
an immediate consequence that follows from the Crooks 
relation Eq.(fT5|). For completeness we repeat this deriva- 
tion here. Multiplying both sides of the Crooks relation 
by Pi^o(— W), integrating over W, and taking into ac- 
count the normalization of P(W); one obtains 



exp 



T 



= exp 



F{X,)-F{Xo) 



T 



(23) 



which is the Jarzynski relation. From here follows that 



(W) > F{Xi)-FiXo) 



(24) 



This variation of the 2nd law of thermodynamics is 
known as the maximum work principle^ because it sets an 
upper bound on the work W = —W that can be extracted 
from a work process. Optionally it can be regarded as 
the minimum work W needed from the agent to do the 
process . Note that our sign conventions for W and Q 
are opposite to those that are used in most textbooks. 



VIII. WASTED WORK AND ENTROPY 
PRODUCTION 



difference AF = F{Xi) — F{Xo) is the minimum work 
that is required in a reversible quasi-static process. Ac- 
cordingly the difference W — AF can be regarded as the 
wasted work in a realistic process. Dividing by T we get 
a quantity AS^ that we can regard as the wasted entropy 
(For the temperature we use units such that the Boltz- 
mann constant is unity). Consequently the fluctuation 
theorem Eq. p^ reads: 



Po-^i(Ag^) 
Pwo(-A5^) 



exp [ASu 



(25) 



Below we would like to better clarify the connection with 
thermodynamics, and in particular with the Clausius ver- 
sion of the 2nd law. 

Taking a puristic point of view, one defines thermody- 
namic functions only for equilibrium states. Therefore let 
us assume that the system ends up in a thermodynamic 
equilibrium, say by allowing it to relax at the end of the 
driving process. Under this assumption we can associate 
with the initial and final states well defined values of 
system entropy, whose difference can be expressed using 
thermodynamic functions: 



AS- 



AE-AF 



(26) 



where by the first law of thermodynamics the change in 
the energy of the system is 



AE = W-Q 



(27) 



The total entropy change of the universe is the sum of 
the system entropy change, and that of the bath 

W - AF 

S = A5+^ = ^1^-^^ (28) 

It follows that the Crooks relation can be written as 

PCK^I (5) 



= exp [S] 



(29) 



Pi^o(-5) 

As in the case of the Jarzynski equality we deduce that 



and consequently 



exp [—S] 



{S) > 0, 



1 



(30) 



(31) 



in accordance with the second law of thermodynamics. 
Note that it is only the average {S) that is positive. In 
a finite system S is negative for a fraction of the pro- 
cesses, with vanishing manifestation in the thermody- 
namic limit. 



It is instructive to recast the Crooks relation Eg. ([T5)) 
in terms of entropy produced, as in fact was originally 
formulated by Crooks. From Eq. ([M)) it follows that the 
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IX. SUMMARY 

The objective of this work was to ihuminate that the 
simphcity of the NFT is maintained also in the quantum 
context. The way to go was to regard it a arising from 
a generahzed detailed balance relation Eq. ((TT|) . A key 
issue was to regard the work agent as a dynamical entity, 
and to avoid a continuous measurement scheme for its 
measurement. It was also important to clarify the role 
of the environment, and to show that neither a master 
equation nor a classical phase-space picture are required 
in the derivation. It is possible, and quite instructive, to 
repeat all considerations in terms of the combined states 
of the system and bath, in the manner suggested for ex- 



ample by Fano and Lipkin 
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